Integrate, yes, but what and how? A computational approach of perceptuo-motor fusion in speech perception
نویسندگان
چکیده
HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Integrate, yes, but what and how? A computational approach of perceptuo-motor fusion in speech perception Raphaël Laurent, Clément Moulin-Frier, Pierre Bessière, Jean-Luc Schwartz, Julien Diard
منابع مشابه
Filling the perceptuo-motor gap
Introduction The session under focus deals with phonetic articulatory-acoustic variation and with the link between phonetic detail and phonological modelling. The underlying question was to estimate the impact of phonetic detail on the phonological status of a given unit, and to attempt to better understand how details are produced by the speaker or exploited by the listener to access (encode o...
متن کاملReanalyzing neurocognitive data on the role of the motor system in speech perception within COSMO, a Bayesian perceptuo-motor model of speech communication
While neurocognitive data provide clear evidence for the involvement of the motor system in speech perception, its precise role and the way motor information is involved in perceptual decision remain unclear. In this paper, we discuss some recent experimental results in light of COSMO, a Bayesian perceptuo-motor model of speech communication. COSMO enables us to model both speech perception and...
متن کاملA computational model of perceptuo-motor processing in speech perception: learning to imitate and categorize synthetic CV syllables
This paper presents COSMO, a Bayesian computational model, which is expressive enough to carry out syllable production, perception and imitation tasks using motor, auditory or perceptuo-motor information. An imitation algorithm enables to learn the articulatory-to-acoustic mapping and the link between syllables and corresponding articulatory gestures, from acoustic inputs only: synthetic CV syl...
متن کاملPerceptuo-motor speech units in the brain with COSMO, a Bayesian model of communication
Nowadays, three kinds of theories still discuss the nature of speech units: auditory theories (Diehl, Lotto, and Holt 2004), motor theories (Galantucci, Fowler, and Turvey 2006) and perceptuo-motor theories (Schwartz et al. 2012). Briefly, supporters of the auditory (resp. motor, perceptuo-motor) theories claim that speech units are represented in the brain by auditory (resp. motor, perceptuo-m...
متن کاملThe complementary roles of auditory and motor information evaluated in a Bayesian perceptuo-motor model of speech perception.
There is a consensus concerning the view that both auditory and motor representations intervene in the perceptual processing of speech units. However, the question of the functional role of each of these systems remains seldom addressed and poorly understood. We capitalized on the formal framework of Bayesian Programming to develop COSMO (Communicating Objects using Sensory-Motor Operations), a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017